虽然最先进的对比自我监督学习（SSL）模型产生与监督对应物竞争的结果，但它们缺乏推断潜在变量的能力。相反，规定的潜在变量（LV）模型能够归因于不确定性，诱导任务特定压缩，并且通常允许更可解释的表示。在这项工作中，我们向大规模对比SSL模型引入LV近似值。我们证明，此添加可提高下游性能（导致96.42％和77.49％的测试在CIFAR10和ImageNet上的前1个微调性能，以及resnet50），并产生可用于解释性的高度压缩表示（588倍降低），分类和回归下游任务。

尽管近期寻求自我监督深度学习的许多技术的成功，但对最终学习的陈述有限调查。通过利用最近在对神经表示的比较方面的进步，我们通过比较对比自我监督算法在公共架构中的简单图像数据的监督中探讨了这种方向。我们发现该方法通过不同的手段来学习类似的中间陈述，并且表示在最终几层中迅速发散。我们调查这种分歧，发现这些层非常适合他们独特的学习目标。我们还发现对比物镜隐含地适合中间层的监督目标，但反向不是真的。我们的工作特别突出了学到的中间陈述的重要性，并提高了辅助任务设计的关键问题。

With recent progress in graphics, it has become more tractable to train models on synthetic images, potentially avoiding the need for expensive annotations. However, learning from synthetic images may not achieve the desired performance due to a gap between synthetic and real image distributions. To reduce this gap, we propose Simulated+Unsupervised (S+U) learning, where the task is to learn a model to improve the realism of a simulator's output using unlabeled real data, while preserving the annotation information from the simulator. We develop a method for S+U learning that uses an adversarial network similar to Generative Adversarial Networks (GANs), but with synthetic images as inputs instead of random vectors. We make several key modifications to the standard GAN algorithm to preserve annotations, avoid artifacts, and stabilize training: (i) a 'self-regularization' term, (ii) a local adversarial loss, and (iii) updating the discriminator using a history of refined images. We show that this enables generation of highly realistic images, which we demonstrate both qualitatively and with a user study. We quantitatively evaluate the generated images by training models for gaze estimation and hand pose estimation. We show a significant improvement over using synthetic images, and achieve state-of-the-art results on the MPIIGaze dataset without any labeled real data.

We study the task of learning state representations from potentially high-dimensional observations, with the goal of controlling an unknown partially observable system. We pursue a direct latent model learning approach, where a dynamic model in some latent state space is learned by predicting quantities directly related to planning (e.g., costs) without reconstructing the observations. In particular, we focus on an intuitive cost-driven state representation learning method for solving Linear Quadratic Gaussian (LQG) control, one of the most fundamental partially observable control problems. As our main results, we establish finite-sample guarantees of finding a near-optimal state representation function and a near-optimal controller using the directly learned latent model. To the best of our knowledge, despite various empirical successes, prior to this work it was unclear if such a cost-driven latent model learner enjoys finite-sample guarantees. Our work underscores the value of predicting multi-step costs, an idea that is key to our theory, and notably also an idea that is known to be empirically valuable for learning state representations.

The COVID-19 pandemic created a deluge of questionable and contradictory scientific claims about drug efficacy -- an "infodemic" with lasting consequences for science and society. In this work, we argue that NLP models can help domain experts distill and understand the literature in this complex, high-stakes area. Our task is to automatically identify contradictory claims about COVID-19 drug efficacy. We frame this as a natural language inference problem and offer a new NLI dataset created by domain experts. The NLI framing allows us to create curricula combining existing datasets and our own. The resulting models are useful investigative tools. We provide a case study of how these models help a domain expert summarize and assess evidence concerning remdisivir and hydroxychloroquine.

The recent advent of large language models - large neural networks trained on a simple predictive objective over a massive corpus of natural language - has reinvigorated debate over whether human cognitive capacities might emerge in such generic models given sufficient training data. Of particular interest is the ability of these models to reason about novel problems zero-shot, without any direct training on those problems. In human cognition, this capacity is closely tied to an ability to reason by analogy. Here, we performed a direct comparison between human reasoners and a large language model (GPT-3) on a range of analogical tasks, including a novel text-based matrix reasoning task closely modeled on Raven's Progressive Matrices. We found that GPT-3 displayed a surprisingly strong capacity for abstract pattern induction, matching or even surpassing human capabilities in most settings. Our results indicate that large language models such as GPT-3 have acquired an emergent ability to find zero-shot solutions to a broad range of analogy problems.

Time series anomaly detection has applications in a wide range of research fields and applications, including manufacturing and healthcare. The presence of anomalies can indicate novel or unexpected events, such as production faults, system defects, or heart fluttering, and is therefore of particular interest. The large size and complex patterns of time series have led researchers to develop specialised deep learning models for detecting anomalous patterns. This survey focuses on providing structured and comprehensive state-of-the-art time series anomaly detection models through the use of deep learning. It providing a taxonomy based on the factors that divide anomaly detection models into different categories. Aside from describing the basic anomaly detection technique for each category, the advantages and limitations are also discussed. Furthermore, this study includes examples of deep anomaly detection in time series across various application domains in recent years. It finally summarises open issues in research and challenges faced while adopting deep anomaly detection models.

英国生物银行标准化表型代码的目的与住院的患者有关，但对于许多在门诊环境中接受治疗的患者缺失但缺失。我们描述了一种表型识别方法，该方法为所有英国生物库参与者施加了表型代码。材料和方法POPDX（基于人群的客观表型通过深度推断）是双线性机器学习框架，用于同时估计1,538个表型代码的概率。我们从英国生物库中提取了392,246个人的表型和健康相关信息，以进行POPDX开发和评估。共有12,803个ICD-10患者的诊断代码被转换为1,538个Phecodes，作为黄金标准标签。对POPDX框架进行了评估，并将其与自动多型识别的其他可用方法进行了比较。结果POPDX可以预测训练中罕见甚至未观察到的表型。我们证明了22种疾病类别的自动多型识别及其在识别与每种表型相关的关键流行病学特征方面的应用。结论POPDX有助于为下游研究提供明确定义的队列。这是一种通用方法，可以应用于具有不同但不完整数据的其他生物库。

th骨海星（COTS）爆发是大屏障礁（GBR）珊瑚损失的主要原因，并且正在进行实质性的监视和控制计划，以将COTS人群管理至生态可持续的水平。在本文中，我们在边缘设备上介绍了基于水下的水下数据收集和策展系统，以进行COTS监视。特别是，我们利用了基于深度学习的对象检测技术的功能，并提出了一种资源有效的COTS检测器，该检测器在边缘设备上执行检测推断，以帮助海上专家在数据收集阶段进行COTS识别。初步结果表明，可以将改善计算效率的几种策略（例如，批处理处理，帧跳过，模型输入大小）组合在一起，以在Edge硬件上运行拟议的检测模型，资源消耗较低，信息损失较低。

增强学习（RL）在接触式操纵中的经验成功（RL）从基于模型的角度来理解了很多待理解，其中关键困难通常归因于（i）触点模式的爆炸，（ii）僵硬，非平滑接触动力学和由此产生的爆炸 /不连续梯度，以及（iii）计划问题的非转换性。 RL的随机性质通过有效采样和平均接触模式来解决（i）和（ii）。另一方面，基于模型的方法通过分析平滑接触动力学来解决相同的挑战。我们的第一个贡献是建立两种方法的简单系统方法的理论等效性，并在许多复杂示例上提供定性和经验的等效性。为了进一步减轻（II），我们的第二个贡献是凸面的凸面，可区分和准动力的触点动力学表述，这两个方案都可以平滑方案，并且通过实验证明了对接触富含接触的计划非常有效。我们的最终贡献解决了（III），在其中我们表明，当通过平滑度抽取接触模式时，基于经典的运动计划算法在全球计划中可以有效。将我们的方法应用于具有挑战性的接触式操纵任务的集合中，我们证明了基于模型的有效运动计划可以实现与RL相当的结果，而计算却大大较少。视频：https：//youtu.be/12ew4xc-vwa